FILE  COPYj  AD  A 08 82 45 


« 


UNCLASSIFIED 


SECURITY  CLASSIFICATION  of  THIS  PAGE  (When  Data 


.  REPARAfM^MfiER  —l  IT J  -  /  '  "TT  REI 

^IdsRlhrR&s  0 - 05 iMaT Aht  9  Jjt£ 


REPORT  DOCUMENTATION 


READ  INSTRUCTIONS 
BEFORE  COMPLETING  FOR..I 


4.  TITLE  (and  Subtitle ) 


[APPROXIMATION JpHEMES  FOR  THE  NEAR -QUADRATIC 

Optimal  jontroiTproblem  associated  wiTh  j 

DELAY-EQUATIONS*'"  ^ 


0 


Kar^/xunisch 


(UfAUr  10  /  <M 


6.  CONTRACT  OR  GRANT  NUMBERfsj _ 

riwi^TF  1 1  -  z-jsn  i 

[^AFlJsR-7  6—3^92 


9.  PERFORMING  ORGANIZATION  NAME  AND  ADDRESS 

Brown  University 

Lefschetz  Center  for  Dynamical  Systems 
Providence,  RI  02912 _ 


It.  CONTROLLING  OFFICE  NAME  AND  ADDRESS 

Air  Force  Office  of  Scientific  Research/NM 
Bolling  AFB,  Washington,  DC  20332 


14.  MONITORING  AOET-  LAME  *  ADDRESS  (it  different  from  Controlling  Office) 


II 


RECIPIENT’S  CATALOG  NUMBER 


5.  TYPE  OF  REPORT  ft  PERIOD  COVERED 

Interim  ^  -/  &  ■' 


"CRFORMINO  010V  REMUM  TnUMBER 


nr.  phuuram  elcmcmTi  nnojscT,  task 
AREA  ft  WORK  UNIT  NUMBERS 


12.  report  da< 
March  1980 


13-  NUMBER  OF  PAGES 

70 


15.  SECURITY  CLASS,  (ol  this  report) 

UNCLASSIFIED 


15a.  DECLASSI  F|  CATION/ DOWN  GRADING 
SCHEDULE 


16-  DISTRIBUTION  STATEMENT  (of  this  Report) 


Approved  for  public;  release  distribution  unlimited. 


17.  DISTRIBUTION  STATEMENT  (of  the  abstract  entered  /a  Block  20,  It  different  from  Report) 

AUG  2  6  1980 


DT1C 

ELECTS 


10.  SUPPLEMENTARY  NOTES 


19.  KEY  WOROS  ( Continue  on  reverse  aide  if  neceaamry  and  Identify  by  block  number) 


2^  ABSTRACT  (Continue  on  reverse  aide  If  necessary  and  Identify  by  block  number) 

The  linear  regulator  problem  for  delay  equation  is  discussed.  We  propose  a 
(theoretical)  solution  involving  Riccati  integral  equations  and  them  axiomati- 
cally  discuss  a  general  approximation  scheme.  The  details  are  given  for  spline 
and  averaging  approximations. 

* 


f 

4 


0D  1  JAN  71  1473  <  COITION  OF  1  NOV  0S  IS  OBSOLETE 


UNCLASSIFIED 


tip 


t»riil»ltv  '■‘I  Ft'*  ftTinN  YmiF  *AGF  Pn»Fr* Mf> 


J 


KFQSR-TR-  8  o  -  0  5  7  T 


APPROXIMATION  SCHEMES  FOR  THE  LI NEAR -QUADRATIC 
OPTIMAL  CONTROL  PROBLEM  ASSOCIATED  WITH  DE LAY - EQU AT I ONS+ 


by 


Karl  Kunisch 
Institut  fur  Mathematik 
Technische  Universitat 
Kopernikusgasse  24 
A-8010  Graz,  Austria 


and 


Division  of  Applied  Mathematics 
Lefschetz  Center  for  Dynamical  Systems 
Brown  University 
Providence,  R.  I.  02912 


March  1980 

_ 80  s  14  12? 

This  research  was  supported  in  part  by  the  Air  Force  Office  of 
Scientific  Research  under  Contract  •P-AFOSR  76-3092#  and  in  part 

by  the  U.S.  Army  Research  Office,  under  ARO-DAAG  29-79-C-0161 . 

Approved  for  publio  releas»| 
distribution  unlimited. 


approximation  schemes  for  the  li near -quadratic 

OPTIMAL  CONTROL  PROBLEM  ASSOCIATED  WITH  DELAY- EQUATIONS 


Karl  Kunisch 

Abstract :  The  linear  regulator  problem  for  delay  equation  is 
discussed.  We  propose  a  (theoretical)  solution  involving  Riccat 
integral  equations  and  then  axiomatically  discuss  a  general 
approximation  scheme.  The  details  are  given  for  spline-and 
averaging  approximations. 


AIR  FORCE  OFFICE  OF  SCIENTIFIC  RESEARCH  (AFSC) 

NOTICE  OF  TRANSMITTAL  TO  DDC 

This  tech.)  •  cal  report  hu..  been  reviewed  and  Is 
approved  tor  pu*..i..»c  release  IAii  AiR  ISCSIS  (7b) • 
Distribution  is  unlimited* 

A.  D.  BLOSE 

Teohnioal  Information  Offioor  ^ 


i 


1 


1 .  Introduction  and  Notation 

The  problem  of  approximating  delay-differential  equations  by 
sequences  of  either  ordinary  differential  equations  or  algebraic 
equations  has  stimulated  research  for  over  fifteen  years  now. 

However,  it  was  not  until  quite  recently  that  convergence  proofs  in 
an  operator- theoretic  framework  were  given;  see  [1]  and  the 
references  given  there. 

In  this  paper  we  address  a  specific  problem  of  the  above  type, 
namely  the  approximation  of  the  regulator  problem  of  minimizing  a 
quadratic  cost-functional  subject  to  a  delay-or  more  generally  a 
functional  differential  equation  (FDE) .  This  question  also  has 
attracted  attention  for  quite  some  time  .  Ii*  [13,15]  Ross  and 

Flugge-Lotz  and  Solimon  and  Ray  specify  certain  approximation  schemes 
leaving  open  the  question  of  convergence.  In  today's  terminology 
their  methods  would  be  called  averaging  projections  or  linear  inter¬ 
polating  spline  scheme  [1,8].  Not  only  does  the  question  of  approxima¬ 
tion  of  the  linear-quadratic  control  problem  for  (FDE)  present 
difficulties,  but  the  theoretic  development  of  existence  of  solutions, 
deriving  a  feedback  law  and  discussing  an  operator  Riccati  equation 
is  challenging  as  well.  Delfour  treats  these  theoretic  aspects 
in  [4,5]  and  proves  convergence  of  the  averaging  scheme,  discretizing 
space  and  time  variables.  We  also  refer  to  [5]  as  a  reference  on 
the  literature  to  the  linear-quadratic  optimal  control  problem  for 
(FDE)  up  to  (1977). 

In  the  present  paper  we  develop  a  general  theory  for  the 
above  mentioned  problem,  which  we  subsequently  apply  to  the  spline  and 
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averaging  approximation  schemes.  The  theoretical  aspects  are  greatly 
facilitated  by  a  recent  paper  of  Gibson  [6]  in  which  an  abstract 
linear-quadratic  optimal  control  problem  is  treated  in  a  general 
Hilbert  space;  it  was  observed  that  the  Riccati-operators  satisfy 
two  (almost)  equivalent  Riccati  integral  equations,  one  of  which 
coincides  with  the  one  used  by  Delfour  in  [5],  the  other  one  ((2.17) 
in  this  paper),  although  implicitly  present,  was  not  dealt  with,  in  [5], 
It  should  be  noted  that  in  our  presentation  the  treatment  of  the 
original  problem  (as  opposed  to  the  approximating  ones)  is  based 
solely  on  integral  equations.  A  second  important  feature  is  that 
we  avoid  using  the  infinitesimal  generator  of  the  adjoint  of  the 
solution  semigroup  associated  with  the  (FDE) .  All  the  estimates 
depend  heavily  on  the  fact  that  even  in  the  abstract  formulation  of 
the  (FDE)  (see  (2.4)),  the  control  term  enters  only  as  an  operator 
with  finite  dimensional  range. 

Many  of  the  technicalities  here  arise  from  the  fact  that  we 
intend  to  not  only  prove  convergence  of  optimal  controls,  trajectories, 
payoffs  etc.,  but  also  want  to  give  some  error  bounds.  This  leads 
to  an  essential  difficulty  which  is  described  at  length  in  Remark  2.1. 

The  paper  is  organized  in  the  following  way.  Section  2 
contains  the  statement  of  the  problem  and  its  (theoretical)  solution. 
Then  a  sequence  of  approximating  problems  is  specified  and  the 
convergence  results  are  stated,  leaving  technical  proofs  to  Section  5. 
In  Section  3,  we  first  show  how  the  results  of  Section  2  can  be  used 
for  spline  approximation  schemes.  For  linear  and  cubic  splines  we 
give  all  the  details,  demonstrating  convergence  of  the  linear  spline 
scheme  and  quadratic  convergence  on  certain  subspaces  of  the  cubic 


3 


» 


spline  scheme.  Averaging  projection  schemes  are  discussed  in 
Section  4;  the  approximating  equations  in  this  case  turn  out  to 
coincide  with  those  proposed  in  [2],  [13]  and  [15]. 

Most  of  the  notation  that  is  used  throughout  the  paper  is  quite  standard. 
For  a  closed  interval  Ic(-»«),a  Banach  space  X  with  norm  |*|x  and  p  >  1, 


the  equivalence  class  of  measurable  functions 
j^|x(s)|pds  <  00  is  denoted  by  LP(I;X).  (•) 

I • I  „  is  the  notation  for  the  usual  norm  in 


x:  I  X  with 

or  simply 

LP(I;X) 

LP(I; X).  The  space  of 


continuous  functions  on  I  with  values  in  X  endowed  with  the 

v 

supremum  norm  is  denoted  by  C(I;X)  and  C  (I;X),  k  =  1,2,... 

stands  for  the  space  of  X-valued  continuous  functions  which  possess 

k  2 

k  continuous  derivatives  on  I.  W  ’  (I ; X) ,  k  *  1,2,...  is  the  space 

of  (k-1) -times  continuously  differentiable  functions  whose  (k-l)-st 

derivative  is  absolutely  continuous  with  derivative  in 

L  (I;X);  |  *  |  v  •>  denotes  any  one  of  the  commonly  employed 

WK’Z(I;X) 

k  2 

W  *  -norms.  The  space  of  all  essentially  bounded  and  strongly 

measurable  functions  from  I  to  X  is  denoted  by  33.(1  ;X).  In  the 

special  case  of  I  =  [-r,0],  0  <  r  <  ®  and  X  =  lRn  we  shall 

2  k  k  2 

abbreviate  the  notation  of  the  function  spaces  by  L  ,C  ,W  *  ,  etc. 

For  Banach  spaces  X  and  Y,  the  set  of  all  bounded  linear 

operators  from  X  to  Y  is  denoted  by  i^(X,Y)  and  for  i^0Rn4R  ) 

we  simply  write  lRnXm.  For  A  €  i^(X,Y)  the  strong  operator-norm 

is  denoted  by  | |A| |  .  A*  stands  for  the  Hilbert  space-adjoint 

^(X,Y) 

of  an  operator  A  from  a  Hilbert  space  H  to  H.  Rn  is  endowed 
with  the  euclidean  norm  |*|  _  and  (•»•)  _  stands  for  the  usual 
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inner  product  in  ]Rn.  For  elements  in  ]Rn  m  we  use  the  spectral 
norm.  Wherever  the  contents  permits  we  drop  the  subscript  of  a 
norm,  simply  using  |  •  |  for  the  norm  of  elements  of  a  Banach  space 

and  11*11  for  that  of  operators  between  Banach  spaces. 

The  state  space  of  our  presentation  will  be  lRn  *  L2(-r,0;]Rn) 
with  the  norm 

/  [0  j  \l/2 

I  Cn,4>)  |  =  (h|  +  P(s)  |4>  (s)  |  as  J 

v  m  j  -  r  7 

where  the  weighting  function  P:  [-r,0]  -*■  F  is  a  piecewise  con¬ 
tinuous  and  positive  function.  We  denote  by  Z  (or  Zp  where 
necessary)  the  space  ]Rn  *  L2(-r,0;lRn)  together  with  the  weighted 
norm.  The  symbol  <•»•>  stands  for  the  natural  inner  product  in  Z 

and  Pj ,  ?2  denote  the  projections  of  Z  onto  its  first  and  second 

j.  k  2 

components  respectively,  if  and  *  stand  for  subspaces  of  Z 
given  by  {(♦(0),$)|  €  C^}  and  {Ofr(0),<fr)|  €  W^’2}  respectively. 

A  family  V(t,s)  of  operators  in  .if(Z,Z)  with  tQ  <  s  <  t  <  t 
is  called  evolution  operator  if  V(s,s)z  =  z,  if  V(t,s)z  =  V(t,r)V(r,s 
and  if  t  +  V(t,s)z  is  continuous  for  all  z  €  Z  and 
t()<s<r<t<t*.  The  derivative  of  a  function  x  is  denoted  by 
x  or  also  x\  and,  finally,  for  x:  [-r,o)  -*■  Kn,  a  >  0,  the  symbol 
0  <  t  <  a  stands  for  the  function  [-r,0]  X  given  by 
xt(s)  *  x(t+s)  foT  s  €  l -r ,0] . 

Acknowledgement : 

The  author  would  like  to  thank  professor  H,  T,  Banks  for 
encouragement  to  work  on  this  problem  and  for  various  stimulating 
discussions. 
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2 .  Approximation  of  the  Linear-Quadratic  Control  Problem 

For  (n,<J>)  =  z  €  Z  and  (tg,t*)  €  ]R  *  JR  we  consider  the 
functional  differential  equation  (FDE) 


(2.1) 


x(t)  =  L(t,xt)  +  f(t),  for  tQ  <  s  <  t  < 


x(s)  =  n,  xg  =  ♦ 


where 


(2.2) 


l  (0 

L  (t  ,<}> )  =  l  A.  (t)4>  (-r.)  +  A  ,  (t,s)<Ks)dj 
i  =  0  1  1  J-r 


Here  we  let  0  =  rQ  <  Tj  <  . . .  <  r^  =  r  and  the  matrix-valued 
functions  A^,  for  i  *  -1,...,£  are  considered  as  operators  in 
Ai  €  C(t0,t*;]RnXn),  for  i  =  0,...,£.aid  A  ^  €  C  (tQ ,  t*  ;  L2  (-r ,  0  gRn><n)) 
respectively,  and  f  €  L2 (tQ , t* ;Fn) . 

We  also  need  to  restrict  our  attention  to  the  homogeneous 
problem 


(2.3) 


*(t)  =  L(t,xt),  for  tQ  <  s  <  t  <  t 


x(s)  -  n,  -  ♦. 


It  is  quite  well  known  [8]  that  solutions  to  (2.1)  and  (2.3)  exist 
and  that  they  do  not  depend  on  'the  representation  of  an  equivalence 


class  ♦  €  1/ 


We  shall  denote  the  solutions  by  x(*,s;z,f) 


and  x(*,s;z)  respectively,  dropping  arguments  if  the  context 
permits  us  to  do  so.  Let  T(t,s):  Z  -►  Z  be  the  solution  operator 
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associated  with  (2.3),  i.e. 

T(t,s)z  =  ((x(t,s;z) ,xt(- ,s;z))  for  tQ  <  s  <  t 

Then  T(t,s)  is  an  evolution  operator  on  A  =  ((t,s)|  tQ  <  s  < 
In  the  next  lemma  the  weighting  function  for  the  norm  of  Z 
is  chosen  identically  1. 


Lemma  2.1.  Exponential  bounds  on  T(t,s)  are  given  by 


I  T(t ,s) z  L 
L1 


<  Me 


w(t-s) 


for  (t,s)  €  A, 


where 


and 


M 


l 

l  sup 

i=l  t€(t0,t*J 


l|A.(t)||)1/2 


“  ■  M2  +  sup  | -|A_1(t  p  •  )  |  |  , 
t€(t0,t*]  1 

with  A_j(t,*)  considered  as  an  element  in  L2(-r,0^RnXn) . 

For  the  proof  see  [12,  Theorems  2.1  and  3.5], 

We  return  to  (2.1)  and  recall  the  following  variation  of 


constants  formula. 


»  A 
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Lemma  2.2.  If  for  z^  €  Z  we  define  z(t,s;zg)€  Z  by 

z (t ,s ; zQ)  =  CxCt,s;z0,f) ,  xt C* ,s ; zQ , f ) )  for  (t,s)  €  A 


then 


(2.4)  z(t,s;zQ) 


T(t,s)zQ 


+ 


I 


tT(t , a)  (f  (cr) 


s 


,0)da. 


for  (t,s)  €  A. 


This  result  is  proved  in  [12)  and  in  the  autonomous  case  it  also 
follows  trivially  from  [1],  [3],  [9], 

In  this  paper,  we  shall  consider  the  following  optimal  control 
problem: 


Find  u  e  L2 (tQ , t* ;Rm)  which  minimizes 


J(t0,n,<J>,u)  =  (Fx(t*) ,x(t*)) 


(P)  < 


♦  P 

n  k 

rt* 

(C (t)u(t) ,u(t) )  _dt 
Jtft  1R 


(D(t)x(t) ,x(t) )  dt 
]Rn 


subject  to 


x(t)  -  L(t,xt)  +  B(t)u(t),  tQ  <  t  <  t* 

x ( t o )  *  n,  xt  *  ♦ ,  where  (n,<fr)  €  Z  and  tQ,t*  are  given. 


In  the  notation  of  the  cost  functional  J  we  let  x(t)  stand 
for  x(t,tQ; n>$ ,B(t)u(t)) .  The  assumptions  on  F,D,C  and  B  are 
the  following: 
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(2.5) 


F  £  is^QR  ,]R  ),  sel f ad j oint , nonnegat  ive , 

D  £  ^Ctg.t*  ;]RnXn) ,  selfadjoint,  nonnegative, 
C  £  ^ooCt0,t*dRm><m) ,  selfadjoint,  C(t)  >  c  >  0 

for  some  c  >  0  and  almost  all  t, 

B  6  ^wCt0,t*dRm><n). 


For  the  presentation  of  the  approximation  results  we  choose  a 

N 

sequence  of  closed  linear  subspaces  (Z  of  Z  and  orthogonal 

projections 

PN:  Z  ZN,  for  N  =  1,2, . .  .  . 

/ 

We  shall  also  use  the  operator  Qg:  ]Rn  -*•  Z  given  by 
QQn  =  (n,o). 

Of  course,  Qq  can  be  represented  as  an  n  *  n  -  Z- valued  matrix  by 

’  (1,0)  0 

Qo  -  \ 

0  (1,  ) 

» 

where  0  stands  for  the  zero-element  in  Z.  In  general,  we  shall  not 
distinguish  between  the  operator  Qg  and  its  representation.  With 
this  notation  (2.4)  can  be  written  z(t,s;zQ)  ■  T(t,s)z0  +  |^T(t,o)Qgf(o)da. 
Motivated  by  earlier  work  on  approximation  of  (FDE)  [1,3,8]  we  may 
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impose  the  following  hypotheses: 

(HI)  There  exists  a  family  of  evolution  operators  TN(t,s):  Z  ->•  Z, 
for  N  =  1,2,...  and  (t,s)  €  A  such  that 

(i)  |  |TN(t,s)  j|  <  NTeW  (t~s)  for  some  M  >  0,  w  €  IR, 

(ii)  TN(t,s)ZN  c  ZN  for  all  (t,s)  £  A, 

(iii)  there  exists  a  real-valued  function  p  such  that 

| T(t , s) z  -  TN(t,s)z|  <  P(N,z). 

Of  course  in  the  examples  that  we  have  in  mind  will  tend  to  0 
at  a  certain  rate  as  N  goes  to  00 ;  the  dependence  of  P  on  z 
will  also  indicate  possible  dependence  on  derivatives  of  z  (compare 
Section  3). 

(H2)  iim  PNz  =  z  for  all  z  £  Z. 

N-m» 

To  get  estimates  on  the  rate  of  convergence  we  need  to  introduce 

N  n 

a  family  of  operators  Q  :  3R  -*■  Z,  which  act  as  "smoothing  operators" 
for  Q0 . 

M  M 

(H3)  There  exists  a  sequence  of  operators  Q  :  ]R  -*•  Z,  N  =  1,2,..., 
such  that 

(i)  Q^11  c  ZN 

(ii)  ||QN'QnM  „  <  Prt (N)  for  some  real-valued 

u  ^QRn;Z)  '  ^ 

function  Pq 


f 


(iii)  | |QN| |  5  q  for  some  q  >  1, 

y  (IRn ;  Z ) 

independent  of  N. 

Throughout  this  section  we  assume  (H1)-(H3)  to  hold.  A  possible 
N 

candidate  for  Q  is  the  matrix  whose  columns  are  the  orthogonal 
projections  of  the  columns  of  Qq  onto  Z^.  Notice  that  (H3)(i) 
implies  that  there  exist  a  matrix  Qq  £  Jz^(IRn,IRn)  and  a  function¬ 
valued  matrix  £  L^(-r,0;]Rn  n)  such  that  (  (Qq)  j  » (Q^ )  j  )  €  Z^ 

for  j  =  l,...,n,  where  (E)^  stands  for  the  j^*1  column  of  a 

N 

matrix  E.  In  the  examples  that  we  have  in  mind  Q  can  always  be 

2 

chosen  as  a  diagonal  matrix,  with  diagonal  elements  in  1R  *  L  (-r,0^R) 

2 

approximating  (1,0)  £  1R  x  L  (-r.OpR).  The  need  for  introducing  the 
N 

family  Q  to  obtain  estimates  on  the  rate  of  convergence  will  become 
apparent  from  the  analysis  below.  The  underlying  problem,  however, 
can  be  explained  for  real-valued  functions  on  [-1,0]. 

Remark  2.1.  To  demonstrate  the  need  for  introducing  the  family  of 
N 

operators  Q  let  g  :  [-1,0]  £  1R  be  given  by 

Q 

for  s  =  0 
for  s  £  [-1,0). 

It  is  not  hard  to  find  a  sequence  of  functions  g^:  [-1,0]  -*■  1R,  such 

that  (a)  gN(0)  -  1,  (P)  |gN|  2  -  0(^)  for  some  P  >  0,  (y)  gN  £ 

L  N 

W* '^(-1,0;IR)  and  (5)  |g^|  j  <  Mj  for  some  independent  of  N. 

In  fact,  we  may  take 


v 
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SN(t)  = 


Nt  +  1  for  t  €  [-  ^,0] 
0  otherwise 


7  7 

however,  |g  |  ,  diverges  like  For  functions  in  W '  (-l,0dR) 

n  ^ 

we  analyze  the  question  more  precisely:  there  exists  no  family  of 


(gN} 

such 

that 

(i) 

lim 

N 

gNC0)  -  1,  for  all  N 

(ii) 

lim 

N 

|g^|  2  =  0,  f°r  some  P  >  0 
L 

(iii) 

%  £ 

W2,2(-1,0^R) 

(2.7) 


|  (iv)  |gN|  2  -  Mi  an<J  I  gN  I  2  <  M2,  both  uniformly  in  N. 

L  L 

Proof.  Assuming  (i)-(iii),  we  argue  that  (iv)  cannot  hold.  We  first 

show  that  lim  gw(-l)  =  0.  For  suppose  there  exists  a  subsequence, 

N 

again  denoted  by  such  that  g^(-l)  >  a  >  0,  for  all  N.  (The 

case  a  <  0  is  treated  similarly.)  Then 

f e_1 

gN(e*l)  "  gN(’l)  +  J  j  ^N(s^ds  -  0  '  ^  Ml* 

Therefore,  there  exists  eQ  >  0  and  a  >  0  such  that  gN(e-l)  >  a  >  0 

for  all  N  and  e  €  (0,Eq].  This  contradicts  (ii).  Next,  we 

verify  that  lim  gw(-l)  *  0.  If  not,  there  exists  a  subsequence, 

N 

again  denoted  by  gN  such  that  &N(-1)  >  a  >  0,  for  all  N;  (the 
case  a  <  0  is  treated  similarly).  Then 


gN(e-D  *  gN(-D  ♦  e$N(-D  +  f  (e-l-s)gN(s)ds  >  gN(-l)  +  e^-M2  /J) , 


f 
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so  that  there  exist  constants  ^  >  0  and  k  >  0  such  that  gN(t-l)  >  gN(-l)  +  £k, 

for  all  N  and  e  €[0,2^],  which  again  contradicts  (ii) .  In  a 

similar  way  one  can  show  that  lim  gM(0)  =  °°.  Since  the  left-hand- 

N  " 

side  in  the  next  estimate  tends  to  00 

[f0  7 

|gN(0)  -  gN(-D|  1  Ij  il£N(s)|-zds 

we  see  that  (iv)  is  violated  and  hence  the  proof  of  the  above  claim 
is  completed. 

There  is  yet  another  way  of  considering  properties  (i)-(iv), 

interesting  from  the  point  of  view  of  spline  analysis.  We  let 

-  2  2 

sN  €  W  ’  (-1,0 ^R)  denote  the  unique  cubic  Hermite  spline  function 
given  by 


We  recall  that  the  variational  problem  of  finding  the  function 
v  €  W2 » 2 ( - 1 , 0 PR)  satisfying  (2.8)  and  minimizing  |y|  ,  is  exactly 

i  3/2 

the  cubic  Hermite  spline  s^;  but  js^f  £  diverges  like  N  .  Of 

L» 

course,  a  similar  negative  result  can  be  shown  for  cubic  spline  functions. 


13 


» 


To  relate  the  above  observations  to  the  operator  Qq  we  suppose  r  =  n  =  1  and 
ZN  c  { (4> (0) ,4>) |  e  W^’^(-l,0j]R)}.  Then  we  have  demonstrated  that  there  does  not 
exist  a  sequence  of  operators  QN:  K  -*■  ZN  such  that  lim  IIQN'QqM_^]r  Z)  ~  0  an^ 

such  that  |  |  d(p2Q  )l  I ^gR,L2 (- 1 ,0 OR) )  ^  ^  ^flR,L2(-l,0-JR))  are 

uniformly  bounded  in  N  ;  here  d  denotes  the  differentiation  operator. 


To  explain  the  significance  of  the  above  negative  result,  we 

recall  that  in  order  to  get  good  convergence  results  in  spline 

analysis,  the  (L  -and  Tschebyscheff-norm  of  the)  derivatives  of  the 

approximated  function  play  an  essential  role  [11,14].  In  the  next 

section  we  shall  apply  the  general  result  of  this  section  to  specific 

spline  approximation  schemes,  and  it  is  no  surprise  that  again  the 

convergence  of  T  (t,s)z  to  T(t,s)z  depends  on  the  smoothness 

of  z,  (see  [3]).  A  brief  look  at  (2.4)  indicates  that  this  will  cause 

severe  difficulties,  since  under  the  integral  the  operator  T(t,s) 

always  acts  on  a  discontinuous  function.  The  special  form  of  the 

integral  will  help  to  get  the  convergence  result.  But  for  estimates 

of  the  rate  of  convergence  of  control,  state,  payoff  and  Riccati 

N 

operator,  certain  uniformities  in  the  convergence  of  Q  to  Qq  would 
be  needed,  which  for  cubic  spline  approximations  turn  out  to  be  those 
given  in  (2.7). 


To  get  better  results  than  just  convergence,  in  spite  of  the 
above  difficulties,  we  shall  use  the  following  simple  technique, 


which  we  explain  by  using  g^:  For  some  desired  accurracy  e  determine 
a  function  gN  (QN  or  PNQq  later  on  in  this  paper)  such  that 


gN(0)  «  1  and  |gN|  2  £  e-  Moreover,  gN 

L 

that  it  suits  our  smoothness  requirements 


will  be  chosen  in  such  a  way 
for  the  specific  situation 


and  such  that  there  exists  a  sequence  of  functions  g^,  whose 


» 
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convergence  to  g^  is  of  a  desired  rate.  This  ends  Remark  2.1. 

We  return  to  the  development  of  the  theory  begun  prior  to  this  long 
remark  and  aim  at  an  "abstract"  formulation  in  the  space  Z  of 
problem  (P) .  We  shall  need  the  operators  and 

€  ^(t0,t*;^ORm,Z)),  9  and  €  «.(t0,t*;  j^Z,Z))  and  ^ 

and  -^N  €  i/(Z,Z)  given  by 

#(t)  =  Q0B(t)  and  #N(t)  =  QNB(t), 

J*-(n,<}>)  «  (F(n),0)  for  (n,4>)  €  Z  and  FN  =  PN.FPN, 

0(t)(n,*)  =  (D(t)  (n) ,0)  for  (n,*)  e  Z  and  ^N(t)  -  PN^(t)PN. 

Lemma  2.3.  The  operators  &  and  and  3^ and  FN 

satisfy  the  same  properties  as  B,D  and  F  in  (2.5)  respectively. 

Moreover, 

-#*(t)(n,4>)  *  B*(t)n,  for  (n,$)  €  Z  and  tQ  <  t  <  t*,  i 

i 

i 

(^N)*(t)  (M)  *  B*(t)  (Qq)*H  ♦  |  ^B*  (t)  (Qj )  *  (s)$(s)ds,  | 

and 

(#V  and  <3*  6  4fw(t0,t*;if(ZJRm)). 

» 

N  ^ 

Proof.  We  shall  only  verify  the  representation  of  (.sf  )  .  So  let 
v  €  ]Rm,  and  (n,$)  €  Z  be  arbitrary,  then 


f 


<#Nv,(M)>  -  CQnB(t)v,n)  +  f°  (Q?(s)B(t)v,Hs))  ds 

u  ]Rn  J-r  ]Rm 

=  (v,B*(t)(Qj)*n)  _  +  [°  (v,B*(t) (Q^)*(s)^ (s))  ds 
u  ]Rm  '  -  T  1  IR 

=  (v,B*(t)  [(Qq)*ti  +  |°  (Q]1)  *  «♦(*)])  . 

Next  we  introduce  the  family  of  approximating  optimal  control 
problems  in  which  the  original  problem  (^) is  imbedded.  Let 


T°  (t ,  s)  =  T(t  ,s) ,  P°  -  I,  _0°(t)  «  <3(t),Q°  =  Qq, 

0°  *  9  and  F°  * 


and  consider 


C2.9] 


For  tQe  IR,  t*€  K  and  z€  Z  given,  minimize 
J  (tn.P^z.u)  *  <FN+yzN»lJCt*),zN',i(t*)>  + 


t* 

+  f  (<^Nnj(t)zN’»1(t),zN'»i(t)>dt  +  (C(t)u(t)  ,u(t)))dt 

nn 


over  ue  L2(tQ,t*JF!n)  subject  to 


zN,M(t)  -  ^(t.yp^z  +  | t  TN4w(t,n)^N(n)u(n)dn 


for  tQ  <  t  <  t  . 


For  u  ■  N  ■  0  and  by  Lemma  2.2  we  have  (. 9  *  )  -  ( .  We  first  address  ourselves 


* 
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N  u 

to  solving  (  &  ),  N,p  =  0,1,...  and  to  the  question  of  the 

behavior  of  the  solution  of  as  N,p  -*-•*.  Problems  are 

special  cases  of  the  linear  quadratic  optimal  control  problem  considered 
in  [6].  Applying  this  result  we  outline  the  solution  of 

Under  the  assumptions  on  F,D  and  C  the  unique  optimal  controls 
are  the  solutions  of 

J’(t0,PN+Wz(t0),u)v  =  o,  for  all  v  €  L2  (tQ  ,  t*  -JRm) , 


where 


J' (t0,PN+uz(t0) ,u)v 


denotes  the  Frechet-derivative  of  j  at  u  in  the  direction  v , 
Therefore,  after  some  calculations  one  finds  that  the  optimal  controls 
uN>11  are  given  by 


(2.10)  uN’w(t)  =  -((V?»,,)"1W?»|lz)(t)  a. e .  in  [t0,t*] 
where 


€  i^(L2(t0,t*PRm),  L2(t0,t*^Rm)) 

and 

W?'W  €  ^(Z,L2(to,t*0Rm)) 
l0  0 


and 
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(2.11)  =  C  +  (^N)*(^rN+M  )*^N+iyN+U£N 

0  t0  t0 

♦  (^n)*(^+w)*fn+p  jFN+y#N 
t0  t0 

(2.12)  =  (<3V(J^+V^UT?+P  +  (^N}*(jrN+U 
0  z0  t0  t0 

Here 

jr^  E  ^(L2(t0,t‘;Z),  L2(t„,t*;Z)) 

£  if(L2(t0,t‘;Z),Z) 

L0 

T^+U  €  i^(Z,L2(t0,t*;Z)) 

0  u 

are  defined  by 

(yN+^)(s)  =  IJ,',y(s,n)<Kn)dn,  for  $  e  L2(tQ,t*;Z) 

0?^)  -  C^f^)(t*), 

0  *0 

(C^"N  **)*♦)  (0  *  (TN+w)*(n,t)<Kn)dn, 

(C^t^)**Kt)  *  (T^V.t)*,  for  z  €  Z 

ClfWz)(t)  -  T^t.t  )z. 

*0  0 


Consider  for  a  moment  the  optimal  control  problems  (^N» 
J(t0,PN+yz,u)  replaced  by  J(s,PN+MzN,w(s) ,u) ,  t0  <  s  < 


FN+UTN+,JT(t*,to). 


y)  with 
t*;  letting 


» 


ji 

u  *  denote  the  corresponding  optimal  control,  then  it  is  clear 


from  the  above  that 


(2.13)  (Ug’UKt)  =  -((V^*y)'1W^UPN+Uz)(t)  a.e.  in 


if  €  i/(L2(s,t*-JRm),  L2(s,t*gRm))  and  wJJ’u  £  i^(Z  ,L2  (s  ,  t*  JRm) ) 

are  defined  analogously  to  V^,U  and  W^,u  in  (2.11)  and  (2.12) 

0  0  n  p 

respectively.  For  z  €  Z  the  optimal  trajectories  S  *  (t,s)z 
corresponding  to  J(s,P^+^z,u)  are  then  given  by 


(2.14)  SN’W(t,s)PN+Uz  •  TN+y(t,s)PN+Uz 

-  JtTN+u(t,n)^N(n)((V^,w)"1wN>upN+uz)(n)dn. 


In  [6]  it  is  verified  that  S^’^(t,s)  is  an  evolution  operator  on  A 

y 

for  each  N,p  and  moreover  that  u  is  also  given  by 


(2.15)  uN,M(t)  -  -C"1(t)(^N(t))*nN,M  (t)SN,w  (t,tQ)PN+Mz,  a.e., 


with 


(2.16)  HN,M(t)PN+wz  «  (TN+u)*(t’",t)FN+WSN,U(t*,t)PN+Wz  ♦ 
♦  f*  (TN+y)*(n,t)^N+w(n)sN'M(n,t)PN+llzdn, 


for  t0  <  t  <  t  ,  z  e  Z. 


The  basis  for  the  numerical  approximation  scheme  will  be  (2.10)  and 
(2.14)  together  with  the  following  Riccati  integral  equation  for 
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(2.17)  n^Ct^z  =  (TN+y)*(t*,t)FN+U(t*,t)PN+Wz  + 

+  C  cO*(n,t)[^N+ll(n) 

}t 

-  nN,M  (n)^N(n)C'1(n)(^N(n))*nN,p(n)]TN+M(n,t)PN+lJz  dn. 

Since  Z  is  separable,  so  that  T*(-,*)  is  strongly  measurable, 
(2.17)  is  also  a  direct  consequence  of  the  results  in  [6];  moreover 

i 


N  u 

n  ’  (t)  is  nonnegative  and  selfadjoint. 


To  establish  the  approximation  results  we  adopt  the  following 


conventions : 

(i) 

0  as  a  superscript  may 

be  dropped, 

(ii) 

b  *  sup  | | B(t) | | , 

t€[t0,t*] 

(iii) 

c  -  sup  1 | c (t ) 1 1 , 

t€[t0,t*] 

(iv) 

d  -  sup  | | D(t) | | , 

t€[t0,t*] 

(v) 

f  “  l|F|| 

^(Z,Z) 

(vi) 

we  assume  that  M  <  R,  w 

i  < 

(vii) 

by  (Hl)(i),  (iii)  there 

such  that 

exists  a  real-valued  function 

20 


I T C t , s ) z  -  T^(t,s)P^z|  <  P(N,z),  uniformly  in  A; 

_  w(t*-tn)  N 

indeed  P(N,z)  =  P(N,z)  +  Me  u  | P  z - z | , 

(viii)  by  (Hl)(iii)  there  exists  a  real  valued  function  p  such 
that 

||TCt,s)QN  -  TN+M(t,s)QN|  |  <  P(p+N,QN)  , 

<SQ Rn,Z) 

indeed  one  can  let 

PCm+N,QN)  =  yff  max  PCN+M  ,  ((q]J)  . ,  (qJ)  . )) , 

j-1, . , . ,n  J  J 

(ix)  the  constants  to  be  used  below  depend  on  the  following 

variables  of 

=  ^  (n  ^  * d > b  ,c  >q  t tp ,  t  ) 

and  are  calculated  explicitly  in  the  proofs. 


Lemma  2.4, 


(a)  ll»?,U|| 


0  ^(Z;C(t, 


*  m  <  bqR2e2u)  (d(t*-tQ)  +  f)  d«fK 

, , t" dRm) )  0  1 


(b)  ||(V^lJ)-1|| 

^  A 


J  II  1  2  *  m  <  C  . 

0  2^(L2(tn,t  ^Rm),LZ(tn,t*dRm))  • 


(c)  There  exist  constants  K2  and  Kj  such  that  for  all 


z  e  z 
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t 


Remark  2.2.  It  is  simple  to  check  that  the  same  estimates  as  in  the 
previous  lemma  also  hold  for  Vg,P  €  J/(L2  (s ,  t*  ;lRm) ,  L2  (s  ,  t*  ;lRm) ) 
and  W^’P  €  j2f(Z,L2(s,t*;]Rm))  ,  for  s  €  [tQ,t*]. 

~N  U 

Theorem  2.1.  For  the  optimal  controls  u  *  and  u  we  have  the 
2 

following  L  -convergence  result: 

|a-uN*U|L2  t*^  5  c-V-vwiyoi‘,h  *  <!(N*li,QN)|Z|K2 

P(N+ii,z)K3  +  M^Qq-QqI)  |z|k2J  +  c'2(t*-t0)K1|Z|[PQ(N)k3 
+  P(N^,QN)K4  +  llQg-^Qoll^]. 

Proof.  The  proof,  using  Lemma  2.4,  follows  from  the  following  simple 
estimate 


u-uN,U|  7  <  |v;V  z  -  (V^»M)"1W^»PPN+y z| 

¥  “  tn  Irt  Ia  La 


"0  "0 


0  c0 


=  |V*V  Z  -  V'1W^,uPN+pz|  7  +  |V'1wJ,’MPN+Mz  -  (vJ,,p)'1wJ,’pPNnJz|  .  < 

La  t  ^  Ln  vn  Ln 


k0  v0 


"0  "O 


2  - 


L0  t0  t0  *0 

<  c'1!#.  z  -  wJ,,wPN+pz|  -  +  ICvf’VV.  -vJ,’y)(V.  )'1^,pPNnJz|  7  < 
to  to  v  h  t0  *0  t0  t0  u  ' 


<  c^lHL  z  -  w^^p^zl  7  + 
z0  T)  L* 

*  c_2i  >vt.  •  v?:“ 


0  t0  ^(L2(tn,t*^m),L2(tn,t*jIRm))  1  0 


Mt*-tn)1/2M. 


Remark  2.4.  Although  it  is  not  difficult  to  show  that  the  controls 
uN,P;  N,u  ■  0,1,...  are  continuous,  if  B(0  and  C(*)  are  and  that 
VN,P  is  invertible  in  &  (C(tg , t* pRm) ,  C(tQ ,t* dRm) )  it  does  not  seem 
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possible  to  find  a  uniform  bound  on  |j  (V^’U)  1||  . 

yccao.tVj.cctjj.tV)) 

We  shall,  however,  consider  the  question  of  uniform  convergence  of 
the  controls  in  Theorem  2.4. 


Remark  2.4.  The  use  of  Theorem  2.1  will  be  demonstrated  for  the  case 

where  the  subspaces  are  chosen  as  subspaces  of  spline  functions, 

for  example.  Then,  if  one  is  merely  interested  in  convergence  of  the 

~N  u 

optimal  controls  u  ’  one  may  put  u  =  0  and  Theorem  2.1  will 
guarantee  L2-convergence  of  u^0  to  u.  However,  if  the  initial  data  z  €  Z  are 
picked  sufficiently  smooth  one  would  expect  to  find  higher  order 
estimates  on  the  rate  of  convergence.  Unfortunately  even  for  smooth 
initial  data,  one  still  has  to  deal  with  the  "jump"  operator  Qq  used 
in  the  variation-of -constants  formula  (compare  (2.4)  and  (^*N’P)): 
given  any  e  >  0  one  can  determine  N  >  0,  such  that  for  all 
U  -  1,2,... 

I !Qq‘QN| I [c'1(t*-t0)1/Z|z|k1  ♦  c'2(t*-t0)K1|z|k3] 

+  I | PN+UQ0“Q0I I lc'1(t*'t0)1/Z|z|k2  +  c_2(t*-t0)K1|z|k4]  <  e. 

Fixing  N,  Theorem  2.1  guarantees  that  the  optimal  controls  converge 

N 

at  a  rate  given  by  p(N+y,Q  )  and  p(N+p,z)  into  the  e-bound  as 
u  +  «. 

Remark  2.5.  It  can  be  seen  easily  that  Theorem  2.1  remains  true  if 
uN,w  and  u  are  replaced  by  and  ug  as  defined  in  (2.13). 


t 
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For  the  optimal  trajectories  S(t,s)z,  with  (t,s)  £  A,  we  have  the 
following  estimate. 


Theorem  2.2. 

(a)  There  exists  a  constant  ,  independent  of  N  and  P, 
such  that 


|SN,M(t,s)PN+Pz|  <  Ks | z |  for  all  (t,s)  £  A  and 

and  P  ,  N  =  0,1,2,...  . 

(b)  There  exists  a  constant  such  that 


|  S(t,s)z  -  SN’U(t,s)PN+Mz|  <  P (N+P , z)  +  P(N+p,QN)|z|K6 

+  (u-uW’U|  2k5  +  |z|pQ(N)k6, 

L 

where 


1  2w(t  -tg)  1/2 

k  =  bRfi-(e  0  -1)) 

K6  -  bc-Xet'-V1'2^ 


Theorem  2.3.  For  all  z  €  Z  and  t  €  [trt,t] 

-  —  it  " 

(a)  I  |nN,u(t)PN+Pzl  I  <  to)K5|z|  (f +d(t*-tQ) )  . 

(b)  <n(t)z  -  nN,y (t)zN+y,y>  <  (d(t*-t0)  +  f){p(N+P,y)|z|K5 

+  Rew(t*'to)  |y  | [p(N+p,z)  +  |z|p(N+P,QN)K6  + 

+  \u-&’V\  2kS  +  |z|pQ(N)k6  ♦  |  Z  |  Kg  I  |Q0"PN+V1Q01 1 1} » 


for  all  y  £  Z. 


» 


25 

For  u  =  0  we  have  the  following  corollary  to  Theorem  2. 1-2. 3. 


Corollary  2.1.  There  exist  constants  K7,Kg,K9  such  that 

(a)  |G-GN’°|  2  ,  m  5  K7[p(N,Q0)|z|  +  p(N,z)  +  pq(N)|z|], 

L(tg,t^R) 

(b)  |S(t,s)z  -  SN’°(t,s)PNz|  <  Kg[PC*f,Q0)|z|  +  p(N,z)  +  Pp(N)|z|], 

(c)  <H(t)z  -  nN‘°PNz,y>  <  K9[P(N,y)|z|  +  P(N,z)|y| 

+  |y| |z| (Pq(N)  +  P(N,Q0))]. 


Proof.  By  Theorem  2 . 1  we  have 

(2.18)  |G-GN’°|  2  <  K?[pqCN)  |z|f  P(N,QN)|z|  +  P(N,z)  H|p\  *  Q0 II  l*ll- 

1*  (tQ,t  ) 

Nn  [\J  M 

Since  Q 1R  c  Z  and  since  P  is  an  orthogonal  projection, 
|PNQfln  -  Qq n |  <  1 |QN  -  Qq| |  |n|  for  all  n,  which  implies  that 

(2.19)  I  1 PNQ0  *  Q0II  <  Pq(N). 


Also,  for  (t,s)  e  A  we  find 


(2.20)  P(N,QN)  <  | | T(t , s ) (QN - Q0 ) | I  ♦  ||(T(t,s)  -  TN(t,s))Q0||  ♦ 

♦  I |TN(t,s)(Q0-QN)| j  <  2Hew(t's)Pp(N)  ♦  P(N ,Qq). 

Estimates  (2 . 18) - (2 . 20)  imply  (a).  Similar  calculations  prove  (b) 
and  (c). 
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Corollary  2.2.  For  the  payoff  J  the  following  estimate  holds: 

| J(t0,PN+Mz,uN,M)  -  JCtQ,z,u)!  < 

<  [(t*-t0)d  +  f ] K$ |  z |  {2[p(N+y ,z)  +  PCN+y.Q^JzlKg  +  |G-GN’U|  |z|PQ(N)k6J  + 

L  ^ 

+  l|PN+UQ0  -  Q0I |KsJz|>  +  2|u-GNji|  2Kac"1Ct*-t0)1/2sup| |CCt)| j (z| . 

L 

~N  u 

Finally,  we  discuss  the  convergence  of  u  ’  to  u  in  the  supremum-norm . 
For  the  sake  of  a  simpler  representation  we  restrict  our  attention  to 
the  case  u  =  0. 

Theorem  2.4.  If  for  all  z  €  Z,  lim  l?(N,z)  =  0  and  if  B(t)  and 
C (t)  are  continuous  in  t  then 

lim  sup  |G(t)  -  GN’°(t)|  =  0. 

N-*~  t€[tfl,t*] 

We  draw  the  readers  attention  to  the  fact  that  all  convergence  results 
were  obtained  avoiding  any  specific  information  about  the  adjoint 
evolution  operator  or  its  generator.  This  is  quite  important,  since 
the  properties  of  the  adjoint  evolution  operator  are  unfavorable  to 
constructing  approximation  schemes:  if  _o^*(t)  denotes  the 
infinitesimal  generator  of  the  adjoint  evolution  operator,  then 

PI  Dom(jaf*(t))  need  not  be  dense  in  Z 

(see  [4])  and  for  autonomous  (FDE)  Dom(_Qf*)  consists  of  all  elements 
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(n,4>)  e  Z  with  $  absolutely  continuous  on  ^or 

i  =  1 . ,1 ,  and  with  jumps  at  determined  by  A*.  It  would 

N 

therefore  be  quite  difficult  to  find  a  sequence  of  operators  T*(t,s) 

N 

satisfying  properties  analogous  to  (HI)  with  T  (t,s)  and  T(t,s) 

N  * 

replaced  by  T*(t,s)  and  T(t,s)  respectively;  indeed  we  shall  see 
N 

shortly  that  Z  <=  Dom(_Q^(t))  is  a  very  convenient  property  for 
N 

showing  that  T  (t,s)  converges  to  T(t,s),  but  the  analogous  hypothes 
ZN  c  Dom(j^*(t))  would  rarely  be  satisfied. 


» 
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3 .  Spline  Approximation  Schemes 

In  this  section  we  apply  the  results  of  the  previous  one  to 
subspaces  of  spline  functions.  There  are  three  subsections: 

(a)  Generalities,  ( g)  Linear-spline-functions,  (y)  Cubic-spline 
functions . 

(a)  Generalities .  Spline  approximations  for  (FDE)  have  been  developed 
in  [3]  and  we  shall  use  these  results  here.  Throughout,  we  assume 
(2.3)  to  be  autonomous,  so  that  A^,  i  =  -1,0,...,  are  independent  of  t. 

We  recall  that  in  this  case  the  solution  evolution  operator  becomes 
a  semigroup  via  T(t,s)z  =  T(t-s)z  for  z  £  Z  and  (t,s)  €  A,  whose 
infinitesimal  generator  is  given  by  (0)  , )  =  (L  (<}> )  ,<j» )  ,  where 

Dom(j^)  =  {  (n,<J>)  |  <P  €  W1  ’  2  (-r , 0  pRn)  ,  ♦  (D)  =  n}  .  We  specify  a 
weighting  function  for  the  norm  of  Z  by 


g(s)  =  j  for 


s  €  [-r  ,  ,-r  .), 

1  Jl-j+1  l-j 


for  ]  —  1 } . . «  ,1 


Obviously  Zj 

Z  |  |  z 

g 


and 

«  ! 


z 

g 

(n*$  1 


are  equivalent  Banach  spaces,  since 
2^1  <  |  Cn )  |  2  •  We  continue  to  drop  the 


subscript  g  if  only  the  set -theoretic  or  topological  structures 
of  Z  are  important.  Next,  we  repeat  a  general  result  from  [3], 
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N  N  yN  N 

and  call  { Z  ,Pg,_Qe  },  N  =  1,2,...  an  approximation  scheme  if  {Z  } 

is  a  sequence  of  closed  linear  subspaces  of  Z  ,  {P^}  is  the  sequence 

©  o 

N  N  N 

of  orthogonal  projections,  P  :  Z  +  Z  and  {A  }  is  a  sequence  of 

o  o 

N 

operators  Zg  -*■  Z  . 


Theorem  3.1.  Let  {Z^,P^,J3f^>  be  an  approximation  scheme  satisfying 

o 

(i)  ZN  c  Dom(j^) ,  N  =  1,2,.. . 

(ii)  =  Pg^Pg.  N  =  1,2,... 

(iii)  (a)  lim  PNz  =  z  in  1  for  all  z  €  Z, 

g 

(b)  for  some  integer  k  >  1  we  have 

lim  L(^N)  =  L(<J>)  in  mn  and 
N-*"> 

lim  (^)  '  =  *P '  in  L2  for  all  e  C^,  where 
N-h» 

<J>N  is  defined  by  P^  ♦  =  0I>N(0)  ,*N) . 

N 

Then  each  of  is  the  infinitesimal  generator  of  a  Cg-semigroup 
T^(t),  t  >  0,  such  that 


and 


where 


TN(t)ZN  c  ZN,  N  -  1,2,...,  t  >  0 
lim  TN(t) z  -  T(t) z ,  in  Z 

N-*oo 


||TN(t)||z  <  ewt,  !|T(t)||z  <  eut 

g  g 

£  0 

S  ■  T1  *  llAnll  *  \  l  l|A,||2  *  i  |  |A(S)I  |2ds. 

i«l  A  -r 
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We  carefully  avoided  -&* ,  the  adjoint  of  however  we  shall 


need 


&  N  ft 

Lemma  3.1.  The  infinitesimal  generators  of  (T  (t))  ,  the 

adjoint  semigroup  of  T^(t)  generated  by  P^ja^P^,  are  given  by 

o  S 


Dom(aO  =  1 


J*N  -  CP^aCPg)* 


Proof.  Since  is  closed  and  defined  on  Z  it  is  bounded;  there- 

S 

fore  PNja^P^  is  bounded  and  so  is  (P^-O^P^)*  and  Dom(P^ja^Pp)*  =  Z. 

6  &  o  o  o  o 

The  second  claim  follows  from  general  semigroup  theory  [10,  pp .  277]. 

N 

We  need  one  more  condition  on  the  subspaces  Z  : 


dim  Z  =  k.,  <  «  and 
N 

for  each  N  =  1,2,...  there  exists  an  integer P  >0  such  that 
ZN  e  ZN+U . 


We  now  turn  to  a  discussion  of  the  variation  of  constants 

formula  (2.9),  the  feedback  laws  (2.13)  and  (2.15)  and  the  Riccati 

integral  equation  (2.17);  the  assumptions  used  in  the  rest  of  this 

section  are  (H3) ,  (H4)  and  the  assumptions  of  Theorem  3.1. 

N  N 

The  fact  that  by  (H3)  the  columns  of  Q  are  in  Z  ,  together 
with  (H4)  and  T^(t)Z^  c  Z^  imply  that  for  each  N  there  exists 
an  integer  p  such  that  the  right-hand-side  of  (2.9)  is  in  the 
finite  dimensional  subspace  and  therefore, 
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(3.1) 


zN,W(t)  =  -Q^N+WzN,w  (t)  +  QNB  (t)u(t) ,  tn  <  t  <  t 


ZN’M(t0)  =  P*+Pz. 


By  a  similar  argument  we  find  that  IIN’P(*)  satisfies  in  ZN+P 
the  Riccati  differential  equation 


(3.2) 


=  Co'N+w)*nN,M(t)  +  - 

-  [0N+P(t)  -  nN,p(t)^N(t)c'1(t)(^N)*(t)  nN,M(t)] 


for  tQ  <  t  <  t*  , 


nN,P(t*)  =  f^. 


We  also  recall  the  feedback  law 


(3.3) 


uN,W(t)  «-C_1(t)  (^N)*  (t)nN’u(t)SN'w(t,t0)Pg+i‘z, 


where  SN,M (• ,tQ)Pg+pz  is  the  optimal  trajectory  corresponding  to 

(£»N’W). 

To  approximate  ( j?)  by  the  finite  dimensional  problems 
(^N,p)  we  yet  have  to  express  the  various  operators  in  (3.1)-(3.3) 
with  respect  to  some  bases  in  Z^. 


Remark  3.1.  For  the  reader,  who  cares  to  follow  the  calculations 
carried  out  in  this  subsection,  or  the  potential  applicant  of  the 
resulting  finite  dimensional  linear  quadratic  control  problem,  it 
might  be  helpful  to  think  of  JRn-vectors  as  n  x  n  diagonal-valued 


matrices . 
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aM  /\  M 

For  each  N  •  1,2,,..  we  now  choose  a  basis  (£.,...,(3.  ) 

1  kN 

of  ZN.  From  c  Dom(j^)  it  follows  that  *  (8^(0), 8^)  for 

N  12 

i  =  l,...,kM,  with  8.  G  W  *  .  We  shall  need  the  matrix  functions 
N  1 


8 


N 


) 


and 


6n  -  cb" . ek  ) 

1  "n 


Each  element  zN  €  ZN  can  be  expressed  as 


N  N  r  N  ,  ,  N  N  ,  _ 

z  *  8  «  ,  for  a  =  col (a  . .  ,a  )  e  1R 

1  kN 


or  in  terms  of  elements  as 


<N  -  (  l"  rf(0).»  l\w). 

i=l  1  1  i=l  1  1 


N  N  N  N 

The  matrix  representation  of  SX  :  Z  Z  ,  denoted  by  A  and  the 

N 

coordinate  vector  of  P  z,  for  z  *  (n,$)  €  Z  have  been  calculated 

o 

in  [3].  To  present  this  result,  which  is  a  simple  consequence  of 
P^(n,$)  -  (n,$)  1  Z^,  we  define  the  matrices 

/  -  <$*,$*>.  dtf  ^co)*e^(o)  ♦  f°  e^(s)*  As)g(s)ds 

g  *-r 

hN(n,$)  -  <^,(n,*)>7  d2f  flF(0)*n  ♦  f°  eN(s)*^(s)g(s)ds 

g  *  -r 
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and 

(3.4) 

hn 

=  hNaceN),$N)  =  8N(o)*L(eN)  +  (°  6N(s)*eN 

j  _r 

(s)g (s)ds . 

Then , 

if 

Pp(h,4>)  =  BNa^,  the  coordinate  vector 

o 

is  given  by 

(3.5) 

aN  =  (JN)"1hN(n,4>) 

and  the  matrix  representation  of 


by 


(3.6) 


AN  = 


(JN) 


w. 


If  for  any  N,  one  choses  P  satisfying  (H4),  then  the  columns 

k 

of  are  in  Z^+lJ  and  there  exists  a  vector  6^’^  €  1R 

such  that 


(3.7) 


qN  =  gN+P6N,M 


Since  we  think  of  the  approximation  in  N  as  chosen  by  the  user 
according  to  some  desired  accuracy  which  can  be  achieved  by  fixing 
N  sufficiently  large  and  then  by  letting  u  -*■  <*>,  the  following 
formula  will  be  useful 


(3.8) 


6N,m  _  cjNnij-VpN^N 

Zg 


Next,  we  turn  to  (QN+U)*:  ZN+>J  -*>  lRn.  For  $N+W  ■ 
(♦N+W(0MN+W)  €  ZN+m  define  yN+w  e  ,  and  n  €  IRn  by 


$"*“  =  jN^yN*U  and  (qN*M).jN.U  . 


Then  for  all  x  €  ]R 


<QN*\, .  (i,(qN*V*N*“) 
8 


or,  equivalently 


<BN*U«N-%,  6N‘UYNt“>.  .  Cx, 


7  _  >.A,n) 

g 


We  use  Remark  3.1  and  easily  deduce 


C«N-V  jn*uyn*u  -  n. 


N  *  N* 

Therefore,  the  matrix  representation  [ CQ  )  ]  of  Q 


(3.9)  KQN)*]  =  («N’W)*JN+M  -  (6N'°)*<&N,BN+w>. 


N  M  M  * 

Let  A*  denote  the  matrix  representation  of  (P  ) 

8  8 


(3.10) 


.N  ( tN> - 1 ,  .N, *  TN 
A*  =  (J  )  (A  )  J  . 


Indeed,  let  ♦  -  (♦(<)),♦)  €  ZN  and  $  *  (i *(0),»)  €  ZN 
by 


♦  ■  8NpN  and  i  ■  for  PN  €  *".S  € 
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is  given  by 


,  then 


be  given 


I 
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Then  the  equality 


£  M  W/v 

<*,p"j*p„¥>7 

g  g  z 


g 


implies 


<6Na“pN,6NcN>z  -  4NpN.8W>,  , 


so  that 


j>w>z 


*  ^  yN6NpN  yNANraNi  N 
Vl  A'  iJ6‘(A 

which  upon  interchanging  v  by  j  on  the  right  hand  side  becomes 


Since  ♦  and  $  are  arbitrary,  the  last  equation  has  to  hold  for 
all  vectors  P  and  o^,  and  therefore 


7N<oN  iN  ,.Nx  rN  sN  sN  ,  N 

i»l  i’ev  Zg(A^i,j  =  iJ1<3j  ,6i>(A  >i,v  fora11  j  "K1  v-1 . . 


This  equality  implies  (3.10) 


We  notice,  of  course,  that  if  % . $  were  an  orthonormal 

basis  then  A*  would  equal  CAN)\  To  find  the  matrix  representation 
fD  (t)J  of  ^N(t)  -  Pg^(t)Pg  we  let  $N  -  0f>N(0)  ,<|>N)  €  ZN 


and 
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define  e  ]R  ^  and  yN  f  R  N  by 


»N  -  6N»N  and  -  eV. 


Therefore 


^N(t)<?N  =  Pg^(t)£N  =  Pg(D(t)4>N(0),0) 


and  by  (3.S) 


YN  =  (JN)'1hN(D(t)<l>N(0),0). 


But 


hV(t)*N(0),0)  «  hNtD(t)3NC0)ctN,0)  =  DN(t)ctN 


where 


DN(t)  =  3N(0)*D(t)  (3N(0) , 


so  that 


rN  -  tJN)-16Ntt)«N 


or 


(3.11) 


(DN(t)  j  -  (jVWct). 
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N 

In  a  similar  manner  we  see  tha*  the  representation  [F  ]  of 
F  *  P '  yP  is  given  by 

o  o 

[FN]  =  (JN)'1FN, 

where 

-w  N  *  N 
Fn  =  3  (0)  FB  (G)  . 


To  write  equations  (3.1) -(3. 3)  in  terms  of  the  coordinate  repre- 

N  u 

sentative  with  respect  to  the  basis  chosen,  we  let  tt  ’  (t)  denote 

N  u  N  N 

the  matrix  representation  of  the  operators  n  ’  (t)  :  Z  Z  and 
let  w^,P(t)  =  w^,u(t;u)  and  wq’^  be  defined  by' 

zN,M(t)  .  and  pNn^  , 

£>  ^ 


Then  (3.1)-(3.3)  are  equivalent  to 


(3.12)  < 


wN,P(t)  =  AN+\N'P(t)  +  6N'yB(t)uN,M(t)  for  tQ  <  t  <  t* 

w"’U(t0)  -wjj> 

*N,UCt)  -  Aj^u»N.''(t)  *  »N>l,(t)AN*11  - 

-  [DN+P(t)J  -  /l»P(t)fiN*MB(t)C(t)B*(t)dN,p  JN+MirN,p(t) 
*N’P(t*)  =  [FN+P] 

uN,P(t)  ■-C-1(t)B*(t)fiN,P  JN+PitN,P(t)wN,W(t). 


We  close  this  subsection  with  a  final  remark  on  the  choice  of  the 
N 

operator  Q  . 
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N 

Remark .  The  natural  possibilities  of  choosing  Q  are  to 

(а)  either  take  =  P^Qg »  which  by  (3.S)  implies  that 

6N,0  =  (jN)-lpNC0)T 

(б)  or,  if  the  subspaces  are  chosen  as  spline  functions,  to 

N  n 

take  the  representation  of  Q  :  1R  -*■  Z  as  the  interpolating 
spline,  which  at  the  knot  t  =  0  takes  the  value  I 
(identity  matrix)  and  0  (zero-matrix)  on  the  other  knots. 

The  choice  between  (a)  and  (g)  has  to  be  made  on  the  ground  of 

* 

getting  the  best  convergence  for  P(N,QN).  Condition  (H3)  is 
checked  in  essentially  the  same  manner  for  (“)  and  (g). 

(g)  Linear  spline  functions. 

We  begin  this  subsection  with  a  brief  discussion  on  the  rate 
of  convergence  of  the  approximating  semigroups  T^(t)  con¬ 
structed  in  Theorem  3.1.  In  [3]  it  is  shown  that  general  semigroup 
theory  provides  the  following  estimate-' 

There  exists  a  constant  M  =  M(t*,A^,^Q)  such  that 

* 

(3.13)  |CTN(t)-T(t))z|  <  M{|(s/N-j^)z|  +  |o|[^-J^]T(s)aoI-j^)z|ds  + 

+  |[^N-J^]T(t)z|)  , 
for  all  t  £  [0,t*]  and  z  e  DomCo^2). 
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To  give  estimates  on  the  rate  of  convergence  for  our  problem  we 
use  (3.13)  together  with  results  from  the  theory  of  spline  functions  to 
estimate  -+•  srf .  In  spline  analysis  the  estimate  on  the  rate  of 

convergence  of  an  interpolating  spline  always  contains  higher  order 
derivatives  of  the  function  that  it  interpolates.  This  constitutes 
an  essential  problem  for  choosing  QN  and  estimating  P(N,QN),  since 
(M3)  does  not  allow  to  pick  the  representative  of  QN  arbitrarily 
smooth . 

Although  estimate  (3.13)  (which  was  derived  from  general  semigroup- 

theory)  might  be  too  weak  for  the  special  case  of  (FDE) ,  it  nevertheless 

# 

clearly  indicates  that  the  jump  operator  Qq  needs  extra  treatment. 

For  spline  approximation  of  neutral  functional  differential  equations 
this  has  turned  out  to  be  essential,  both  in  theory  and  in  numerical 
work  [ 7 ] . 

N  M 

For  the  rest  of  this  subsection,  we  choose  y  =  0  in  (j?  ’  ) 

and  let  N  =  0,1,2,...  . 

N 

We  denote  by  =  { C<J>  ( 0 )  , <J> )  e  if  |<J>  first  order  spline 

with  knots  at  t ,  j  -  1 , . . .  ,N}  ,  where  t!1  =  -j  ^  ,  j  *  0 . N. 

N 

Pj  stands  for  the  orthogonal  projection 
N 

Zg  -*■  Z^,  N  =  1,...  .  It  is  proved  in  [3]  that  the  approximation 
scheme  { Z^ , }  satisfies  the  hypotheses  of  Theorem  3.1  and 
that  dim(Z^)  =  n(N+l),  Therefore,  for  each  z  there  exists  a  real¬ 
valued  function  p1(N,z)  such  that 

lim  Pj (N, z)  -  0  and  |T(t)z  -  TN(t)z|  <  px(N,z). 

N-**° 
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and 


Thus  (H3)  is  verified. 


Finally 

(3.17)  pCN.qN)  =  IItcoqN  -  TNqJ|  I  * 

-  | I T(t)P^Q0  -  T(t)Q0l|  +  ||T(t)Q0  -  TNPjQ0| |  < 

<  eu>t*  |  |  P^Qq-Qq  I  I  +  &  max(p,  (N, (e . , 0) )  + 

ei 

+  eWt  P1(N,(ei,0)))  < 

<  2  /n(max  P-.(N,(e.,0))  +  max  P.  (N,  (e.  ,0) ) )  . 

e.  1  e. 

i  l 

Estimates  (3 . 14) - (3 . 17)  are  exactly  those  needed  for  the  convergence 
results  of  control,  state,  payoff  and  Riccati  operators  in 
Section  2. 

By  (3.13)  we  know  that  on  subspaces  of  Z,  determined  by 
^  _ 

Dom(ja^  ),  k  >  0,  Pj  will  actually  go  to  zero  with  a  rate  given  by 
convergence  of  the  generators.  But  this  is  always  at  the  expense 
of  Pj  not  only  depending  on  z  but  also  on  (at  least)  the 
L  -norm  of  its  second  derivative.  So  even  if  we  dispense  of  (H3)(i) 
for  a  moment,  high  order  convergence  of  ||T(t)Q0  -  TN(t)Q0||  to 
zero  seems  quite  unlikely  in  the  light  of  Remark  2.1. 

(y)  Cubic  spline  functions 

In  this  subsection  the  general  results  of  Section  2  are  used  to 
N 

discuss  subspaces  Zj  of  Z  given  by 
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=  {($(0) ,4»)  €  #2|  4>  is  a  cubic  spline  with  knots  at  t^,  j  =  0,...N), 
5  3 

where  again  t  ^  ^  j  ,  j  =  0,...,N,  and  P^:  -*■  Z^  are  the 

orthogonal  projections.  It  is  quite  simple  to  verify  that  the 

MM  M  M  M  M 

approximation  scheme  {Z^,P^,j^  with  stf ^  =  P^js/P^  satisfies  the 

N 

conditions  of  Theorem  3.1  with  dim  Z^  =  n(N+3)  and  that  for  u  =  0 
we  can  derive  results  similar  to  subsection  (8).  CHI)  is  therefore 
trivially  satisfied.  Here,  however,  we  restrict  our  attention  to 
the  question  of  rate  of  convergence  on  subspaces  of  Z. 

For  k  =  1,2,...  we  introduce 

# 

2>k  =  {(♦(<>),*)  e  rk’2|  <j>  e  w**1’2,  4>(l)(0)  =  LC**1"15),  i  =  i,...,k). 

Notice  that  @  is  the  domain  of  the  infinitesimal  generator  of 

the  solution  semigroup  of  the  autonomous  equation  (2.3)  if 

k  2 

considered  in  the  Banach  space  if  ’  ,  (with  its  natural  norm). 

In  particular,  this  implies  that 

9/>k  is  dense  in  Stk*^ ,  k  *  1,2,...  . 

Moreover, 

lr  w  1 

if  z  e  then  z  £  Dom(JJ^  ). 

In  f3]  it  is  proved  that  for  $  *  ty(0),^) 
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Notice  that  this  choice  of  s3  lets  the  diagonal  of  the  repre- 

N  \j 

sentative  of  Q3  become  a  basis  function  of  ZN  (possibly  after 

multiplying  with  some  scalar)  in  the  commonly  chosen  de  Boor  basis, 

The  function  s3  can  be  explicitly  represented  as 


s3(t)  - 


C?)S(^)3  for  t  G  [- 

0  otherwise  , 


and  a  short  calculation  yields 


(3.18)  0  (N)  -  | |Q  -  qN  ||  -  0(-i) 

y  3  ^0Rn,z)  SR 


(5.19)  IIQ0-PNQ0II  „  *  0(— ). 

U  0  SfQRn,  Z)  SR 

The  special  form  of  Q3  and  (3.18)  imply  (H3)(i)  and  (ii).  (H3) 

(iii)  is  verified  easily.  If  y  +  N  is  some  multiple  of  N  then 
(H4)  holds  and  (H2)  is  a  consequence  of  (3.16)  and  density  of 
in  Z.  Finally  bounds  on  p(N+m,Q^)  are  given  via  the 
following  lemmas.  For  $  =  (♦(()),♦)  €  if  let  denote  the 

interpolating  cubic  spline  function  defined  by 


♦  l(tj)  *  ♦(fj)  for  j  -  0, . . .  ,N 

(♦?)'(0)  -  -  0. 
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Lemma  5.2.  For  all  I  -  (.♦(0),$)  £  3)  we  have 


(3.20) 


^  I  «  0(l7)|*cs)|  , 

b  b  U  L2 


1  f  3) 

where  0(— *•)  depends  only  on  L  and  ♦'■■■'  denotes  the  third 

derivate  of  <J> . 


N 

Proof.  Since  is  an  orthogonal  projection 


J  P^ja/$  -  ]  z  =  min  |  z  -  |  z  5  /l  |  (♦)  j  -  ♦  |  2 » 


where  we  used  the  fact  that  4>  €  and  /I  is  a  consequence  of  the 

weighting  function  g.  The  last  estimate,  [14,  Theorem  4.5]  and 
<)>  €  imply 


(3.21) 


|  P 3  -  S*'4\  «  Il2- 


now  turn  to  estimate  j#Pj4>  - 


and  let  P^  =  (<pN(0)  ,<|>N) 


Then 


|  t»N-*)’|  2  <  !(♦%?)'!  2  *  I  I  2  5 
<  c1n|,n-*J|l2  ♦  °(jjz>l*(3)lL2- 

where  the  first  term  is  estimated  by  the  Schmidt  inequality 

[14,  pg.  7],  the  second  by  [14,  Theorem  6.9],  and  is  a  constant 

independent  of  N  and  $ . 
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The  last  inequality  implies 

(3.22)  |D(<j>N-4>)|  2  =  0(i7)|*C3)|  2. 

L  hT  h 

A  similar  calculation  gives 

sup  |4>(s)  -  *N(s)|  =  0(iy)  |  ,, 

s€[-r,0]  N*  l 

and  therefore,  since  L  is  a  bounded  linear  function  from 
C(-r,0^Rn)  -*■  ]Rn 

(3.23)  |  L  (<)>  -<|>N)  |  <  0(i,)|*(3)| 

N*  lL 

(3. 21) - (3. 23)  are  used  in  the  final  estimate 

<  +  |P^jar$-j3?$|  <  0(iy)  1 4»  ^  |  7, 

which  ends  the  proof. 

Lemma  3.3.  For  all  N,  and  t  €  [0,t*J 

|(TW(t)  -  T ( t )  ) Q j |  -  0(iy)  |s5l 

^0Rn ;  Z )  w  W3,2(-r,O0R) 

Proof,  For  an  arbitrary  j  let  -  (q^CQ),qN)  *  CQ^Jj* 
that  qN  €  W3'2(-r,0iRn),  so  that  by  density  of  in 


Notice 
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7  n  n  7 

Hr’  (-r,Q;lR  )  there  exists  a  sequence  of  functions  q  6  & 


such  that 


(3.24) 


-  -N  .  w3,2 

qn  ■*  q  m  w 


We  turn  to  estimating  |Ty(t)qn  -  T(t)qnl  first.  Since  qn  €  W4’2 
there  exists  a  constant  k^ ,  depending  only  on  L  and  t*  such  that 


(3.25)  -  kll^n^3,2  for  t£[0,t*]. 

Using  the  fact  that  ci  €  it  is  easy  to  check  that 

(A0I-_aOqn  €  ^2,  for  some  fixed  >  u>.  Therefore,  there  exists 

another  constant  k2,  depending  only  on  L  and  t*  such  that 

(3.26)  |T(t)  (Xo-^)qnlw3,2  5  ^2  ^n^3, 2 

If  we  use  (3.25)  and  (3.26)  together  with  (3.20)  in  (3.13),  we  get 


|TUtt)5n  -  T(t)q„|  -  0(lI)|qnli(3i2, 


where  the  0(iT)-term  is  independent  of  q  and  t  £  [0,t*].  The 

y L  n 

last  estimate,  together  with 


|T“(t)qN  -  T(t)$N|  <  |T“(t)$N  -  Tu(t)qn|  .  |Tu(t)qn  -  T(t)$n|  . 


♦  |T(t)<jn  -  T(t)qN|  s  2eSt  |qN-q„|  *  0(‘  )  |qN|  ♦ 

N  n 

*  OCjz>IV«V'*’ 
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which  implies  the  claim. 

The  estimates  (3 . 15) - C3. 19)  and  Lemma  3.3  are  exactly  those 
estimates,  which  are  needed  to  apply  the  results  of  Section  2,  and 
essentially  establish  that  cubic  spline  approximations  to  the  linear- 
quadratic  optimal  control  problem  (P)  are  0(^-=-)  convergent  for 
trajectories,  controls  and  payoffs,  if  the  initial  data  are  chosen 
from  certain  subspaces. 
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4 .  The  Averaging  Approximation  Scheme 

When  applying  the  results  of  Section  2  to  averaging  approxima¬ 
tion  schemes,  the  approximating  state  -  and  Riccati  equations  are  found 
to  be  of  particularly  simple  structure;  moreover  for  the  class  of 
problems  under  consideration  we  find  exactly  those  equations  approxima¬ 
ting  problem  (P)  that  were  first  proposed  in  [13]  and  [15];  they 
were  also  derived  in  [2],  and  convergence  proofs  for  controls, 
state  and  payoff  are  provided  in  [1]. 

For  any  positive  integer  N  we  partition  the  interval  [-r,0] 

into  the  subintervals  [tj,tj_j]  with  tj  =  ,  for  j  =  0,...,N. 

N  N  N 

Let  Xj  denote  the  characteristic  function  of  [t^t.  ^)  for 

N  N  N 

j  =  2,...,N  and  is  the  characteristic  function  of  [ t 1 , tQ ] . 

N 

Then  the  averaging  approximation  subspaces  L  of  Z  are  defined 

3.  v 

by 


Zav  =  h  €  Rn,  4> 


-  v  N  N  N  _  TOn, 
~  Z  v-X- ,  v.  €  K  } 
j=l  J  J  J 


We  note  that  (n,0)  £  Z^v  for  each  n  £  ]Rn.  It  is  simple  to 
calculate  the  orthogonal  projection  P^y:  Z  -+  Z^j  ;  indeed  for 
C n ,<l» )  e  Z  we  have 


(4.D  Pj!v(n,«»)  •  (n,  I  ♦?x?) 

j  =  l  J  J 

t N 

N  N  f  1 ' 1 

where  <]>?  *  -  <f>  (s)ds. 

J  r  J  N 

j 

A  scheme  for  approximating  T(t)  using  the  subspaces 
has  been  derived  in  [1].  This  "averaging  approximation  scheme"  is 
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described  next.  Again,  we  assume  that  the  matrices  Ai  in  (2.2) 
are  independent  of  t  and  define  a  sequence  of  operators 


.N  .  _  _N  . 

a f  .1+1  by 

-^av  av  7 


*■!>•♦>  ■  <v  *  jj  jjVSS<j  ij 


where 


$0  =  n*  =  ?  [  4>(s)ds,  and 

U  J  r  J  M  J 

tv 
J 

It  was  shown  in  [1]  that 


tN 

N  f  I'1 

-  A  (s)ds,  j 

tN 

J 


=  1, . . . ,N. 


if  we  fix  the  weight  functions  P  =  1 
'^av  generates  semigroups  T^w(t)  such  that 


(4.2)  * 


av ' 


Tav(t)H  -  M*eU  Z  for  t  >  °»  with  M*  *  M* (Aj)  and 


=  a>*(A.) 


nN  „N 


av  av 

av 

lim  z 

=  z , 

for 

all  z  £  Z, 

N  av 

1  T (t) z  • 

tn 

lav 

Ct )  z  | 

5  Pav(N,z) 

N 


av' 


for  t  in  compact  subsets  of  [0,“) 


so  that  (HI)  and  (H2)  of  Section  2  are  satisfied.  The  operators 
0N  are  chosen  as 


(4.3) 


0^  _  pN  Q  m  _ 

v  "  av^o  ^0’ 


which,  of  course,  implies  that  (H3)  is  trivially  satisfied.  By  (14.1) 
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we  also  have 

(4.4)  FN  =  9,  9N  =  9  and  9N  =  &  =  QqB. 

Now  the  estimates  of  Section  2  can  be  applied;  for  the  optimal 
controls,  for  example,  we  get  by  Corollary  2.1 


(4.5) 


u-u 


n;  o , 


LZ(t0,t*  ^Rm) 


^av^VM 


Pav(N,z)], 


and  similarly 

* 

+  Pav(N,z)], 

<  t*, 

t 

(4.7)  I <n (t) z  -  nN,0(t)PNz,y>|  <  K^v[Pav(N,y)|z|  + 

+  Pav(N,z)|y|  +  | y | | z| P(N,Q0) ] 


(4.6)  I S (t ) z 


sN,°(t)pN  z|  < 

av  ^  av  1  - 


cri5avCN,Q0)|2| 


for 


t0  - 


and  by  Theorem  2.2 

(4.8)  |J(t0,PNz,uN)  -  J(t0,z,G)|  <  KjJ[Pav(N,z)|z|  +  Pav(N,Q0)|z|2], 

so  that  in  view  of  (4.2)  convergence  of  optimal  controls,  optimal 
states  and  payoff  as  well  as  weak  convergence  of  the  Riccati  operators 
is  guaranteed. 

Finally  we  give  the  form  of  the  approximating  state  and 
Riccati  equations.  We  use  eo*,*,teN  defined  by 
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eg  =  Cl ,  o )  and  =  CO  »X  j1) »  J  =  l.-.-.N 

N  N  N 

basis  for  Z  .  Since  T  (t)  leaves  Z  invariant,  (2.9)  is 

au  v  '  air  7  v  J 


equivalent  to 


(4.9) 


zN,°(t)  =  A*  zN»°Ct)  +  (B(t)uN(t),0) 


zN,0Ct0)  •  Pav^’*}’ 


which,  in  turn,  is  equivalent  to 


(4.10) 


N  N  N  N 

w  (t)  =  A^vwN(t)  +  col(Bu  (t),0,. 


N , .  ..  J 

W  (tQ)  =  col  (n,«J>1 , . . .  ,<J>N) , 


where  zN,0(t)  =  l  w^(t)e^,  is  defined  in  (4.1),  and 

j  =0  3  3  3 


I  DN 
N  N-l 


A  +  — 

N  N 


o  Si 


.  .  .  0 


here  I  is  the  n  x  n  identity  matrix.  If  we  let  ^av  denote 

NO  N  N 

the  matrix  representation  of  n  ’  :  Z  •*  Z  ,  then  we  find  by 
N  * 

(2.17)  that  ^av  satisfies  an  [tg,t  )  the  matrix  Riccati  equation 
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where 


denotes  the  transpose  of 


av  and 


'D  O']  (F  O' 

[D]  =  ,  [F]  =  ,  [B  (t) 1  =  col(B(t),0 . 0), 

0  OJ  [o  OJ 


[D]  and  [F]  being  of  dimension  n(N+l)  *  n(N+l)  and  [B(t)J  of 

* 

dimension  n(N+l)  x  n  . 

The  optimal  feedback  law  becomes 

(4.12)  uN(t)  =  -C_1[B(t)]*Ti^v(t)wN(t). 

Equations  (4 . 10) - (4 . 12)  completely  describe  the  approximating  linear 
regulator  problem  on  the  finite  interval  (tg,t  ]• 


# 
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5 .  Proofs . 

In  this  section  we  give  the  proofs  of  those  results  that  were 
not  verified  in  Section  2.  In  addition  to  the  conventions  specified 
there,  we  let  P^z  =  z^  for  z  e  Z  and  N  =  1,2 . 


Proof  of  Lemma  4. 


N,U. 


(a)  We  use  (2.12)  to  find  the  following  estimate  for  Wt 

U 

* 

|w^zct)|mm=  |C0N(t))*  |t(TN+u(n,t))*^N+lJ(p)TN+M(n,t0)z  dn|  + 
+  |(^N(t))*(TN+U(t*,t))*FN+MTW+M(t*,tn)z|  < 


.  ,  2«(t*-tn) 

<  bq(t  -t0)Sre  U  d|z|  + 


r2  .  2»(t--t0) 


bqfM  e 


|  z |  -  bqNre 


|z|(d(t*-tft)  +  f). 


(b)  The  conditions  on  C,D,F  and  (2.11)  imply  (b)  after  a  short 
calculation  . 

(c)  For  t  €  [ t q , t * ]  we  have 

t* 

l(W0z)(t)  -  (wJJ^z^Kt)^  *  T*(n,t)^(n)T(n,t0)z  dn  - 

-  #N(t)*J*  TN+u(n,t)*^N+w(n)TN+M(n,t0)zN+udn|  ♦ 

♦  |^(t)*T(t*,t)>T(t*,t0)z  - 

-  ^N(t)^(t*,t)*FN+w^(t*,t0)zNn‘l  - 

“  I I  ♦  |IIw(t)|. 
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The  terms  Iw  and  IIW  are  now  estimated  separately.  Let 
T(t)  ®  sgn  Iw(t),  then 

1  lRm  -  -  (|t  T(n,t)*^Cn)T(n,t0)z  dy,  j?(t)x(t))  - 

* 

-  (I'  lJWu(n>t)*®N*1‘(n)TI(*“(n,t0)zNwdn.^(t,t(t))  - 

* 

=  (f  T(n,t)*^(nyr(n,t0)z  dn,  (<0(t)  -  i3N(t))x(t))  + 

t*  * 

*  (ft  T(n,t)*3>Cn)T(n,t0)z  -  j‘  TW(n,t)‘<2(n)T^n,t0)zN*V  «N(t)x(t) 

* 

*  (/‘  -  ^(-o)TN«(n,t^dn,<At)xM)  < 

* 

<  dM2  fteWCn*t)eU,(n-t0)|z|dn  b  Pn(N)^  + 

Jt  ^ 

* 

+  (  <S(n)CT(n,t0)z  -  'iJ<+W(n,t0)zN‘HJ),  T(n,t)<aN(t)T(t)>  dn  + 

* 

+  f  <^(n)TN+u(n,t0)zN+v‘,  T(n,t)j^N(t)t(t)  -  TN+y(n,t)^N(t)T(t)>7dn  + 

L  ** 

*  f|  <(S*Cn)  -  ®N*>))T^(n,t0)zN**\  ^Cn,t)aN(t)x(t)>zdn< 

_ _ y  25T(t*-trt)  . 

<  b  d»fi  NT|z|  Pq(N)(e  0  -1H2W)'1  + 

«(t*.t  ) 

+  bqd.fi  R(e  0  - 1 )u> _1  [P(NHi,z)  +  PCN+M.Qf1^) | z|  ]  ♦ 

+  bqd.fi  R2(t*-tQ)e  (  o)(2^-1|z|  II^Qq-Qq!!. 

Let  e(t)  ■  sgn  IIw(.t),  then 
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111^)1  <  CHwCt)>e(t)^m  < 

5  (^Ct)*T(t*,t)VT(t*,t0)z  -  JN(t)*T(t*,t)VT(t*,t0)z,  e(t))  ♦ 

+  VT(t*,t0)z  -  ^N(t)*TN+V‘(t*,t)V^+MCt*,t0)zN+W,e(t))  + 

♦  e(t))  = 

=  <T*(t*,t)^T(t*,t)z,  (#(t)  -  ^N(0)e(t)>  + 

+  <^T(t*,t0)z,  T(t*,t)<0N(t)e(t)>  -  <^TN4v(t*,t0)zNnj,  TNnJ(t*,t)^N(t)e(t)> 

*  <(^-PN+W+y(t*,t0)zN4v,  ^(t*,t0)^N(t)e(t)>  = 

_  2£T(t*-t0) 

=  bf.fi  |z|  Me  u  pQ(N)  ♦ 

+  <^T(t*,t0)z  -  (t*,tQ)zNni,  T(t*,t)<3N(t)e(t)>  + 

+  <^TN+yCt*,t0)zN+M,  (T (t* >t)  -  TN^‘(t*,t))^N(t)e(t)>  + 

M  -  2oT(t*-tn) 

+  1 1  9-r U 9  1 1  W2e  0  bq.fi  j  zj  < 

j  2w (t  ~t«) 

<  bf.fi)  a)  n  e  U  pq(N)  + 

+  bqyfi|f|R  e  0  [P(N+q,z)  +  |  zjpCN+ii,^)]  + 

+  bq^|z|Rf2e2i:(t  t<,3£|  IP^Qq-QoI  |  - 

The  two  inequalities  together  imply 


sup  *  (|lw(t)|  ♦  |IIw(t)|)  < 

t^O ' ^  ^ 

pp(N}b.fi  ST2) z|e  0  [ (2u0  _1<1  +  f ]  ♦  pfNni.Q^bqvfi  M|z|  [d(ew(t  V-l)w 


tu(t**tfl)  «(t*-tQ)  .  «(t*-t0) 

+  f  e  0  ]  +  p(N+u  ,z)bq*?i  *T[d(e  -l)w  1  +  f  e  u  ] 

„  ,  „  2£(t*-tn)  ,  2w(t*-t0) 

H!^V%ilbq^R  l*lId(t 'Ve  (2S)  +fe 


]. 


-l 
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Cd]  For  w  e  L^(tg,t  ;]Rm)  we  next  estimate 

lc(y0-vJ’u)w)(t)i  = 

t* 

=  l0OO*T(t*,t)*F  f  T(t*,o)^(o)w(o)do- 

Jt 

■  «"ct)V^ct*.t)*i^  fVv,°)<»VMo)d0|  * 

.  i1*  ,  rt  *° 

+  l0(t)  T(n,t)  ^(n)  T(n,a)^Co)w(o)dodn  - 

'  *  t0 

-  «N(t)f  ^(n.t)  V*”(n)  f  lN*“(n,o)^N(c)K(o)do| 
1  \ 

=  |iv(t)|  +  |iyt)|. 

* 

Again,  we  estimate  Iy  and  IIv  separately.  We  let  e(t)  =  sgn  Iv(t),  then 

ft* 

|lv(t)|  =  c#(t)  T(t*,t)*W  T(t*,o)^(a)w(o)da  - 

h 

t* 

•  ^N(t)*T(t*,t)V[  T(t*,cr)^N(o)w(a)da,  e(t))  + 

Jtn 


+  (#N(t)*T(t*,t)V[  T(t*,a)^N(o)w(a)da,  e(t))  - 

Jto 

^(t'.a^^oMojda,  e(t))  + 

*0 

f*  1N*u(t‘,o)^N(o)»(o)da,  e(t» 
(0 

ft  * 

<T(t  ,t)  Fj  T(t* ,o)&(QMo)dot  .  #N(t))e(t)>  ♦ 

*o 


+  T(t*,a)(<0(a)  -  #V)Mo)dc,  i3N(t)e(t)>  + 

;to 

t* 

*  <&\  TCt*,o)^NCo)w(o)do,  T(t*,t)#N(t)e(t)>  - 

Jto 

-  <?\t  TN*w Ct* ,o)^N(o)w(:(j)do,  * 

t0 

* 

+  <(J,-FN+w)  |  TN+W(t*,o)^N(a)w(c)do,  TN+U(t*,t)^N(t)e(t)>  < 

*0 

<  b2f4fi2  (l*q)p  (N)ew(t*_t>[-L  (e^(t  t())-l)]1/2|w|  -  + 

V  2w  LZ 

t* 

+  <  &\  T(t*,a)^N(a)w(c)da,  (T(t*,t)  -  1N+W(t*,t))^!(t)e(t)>  + 
t0 
t* 

+  <  ?\  (T(t*,o)  -  ^+M(t*,o))^N(o)w(a)dcT,  1JJ+lJ(t*,t)^N(t)e(t)>  + 

*0 

♦  |l^-PN*"5'||bV^H2e5<t‘'t|)) 


ll/-! 


2a) 


w 


<  b2fv5\  R2(l+q)Pn(N)eW^t*"t^  -L 
*  [_2u) 


2“(t*-tn)  “|1/2 
(e  0  -1 


M.2 


a2qf^  P(N+V,(ft|w|. 


2«(t  -tn) 


-1 


20) 


IIQq  -  PWHi(^||fl)2q2«H2eW(t  "t£,) 


1/2 


w(t*-tQ)  *  I/, 

+  e  0  (t*-t„)1/2 


2S>(t*-t0) 
e  -1 


2 u 


1/2 


|w| 


Finally,  with  vft)  -  sgn  IIy(t)  we  get 
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|nv(t)|  =  cnvct),vct))  - 


* 

*  (#(t)*  |  T(n,t)*^(n)  |  T(n,a)^(o)w(a)doan - 

1  Jto 

-  .At)*  j1  TN+M(n,t)*^N+,i(n)  p  TN4y(n,o)^N(o)w(a)dodn,  v(t)) 

t  >tQ 

t*  n 

*  |  T(n,t)*^(n)  |  T(n,a)^(a)w(a)dadn  - 

t*  T) 

-  At)*  |  T(n,t)*^(n)  I  T(n,a)^N(a)w(a)dodn,  v(t))  + 

t:  JtQ 

t*  n  * 

+  (  At)*  |  T(n,t)*#(n)  |  T(n,o)A°)w(o)dodn  - 

^  trt 


* 

-  At)*  J*  TN+M(n,t)*^(n)  |n  dQdn,v(t)  ) 

1  to 

(At)*  j*  TN+v(n,t)*(^Cn)  - 

-  Ay(n))  |  1N+WCri,o]^N(o)w(o)dodri,  v(t))  «= 

t0 

ft  T*(r\,t)@(r\)  [n  T(n,o)(<3(o)  -  <3N(o)Mo)d°dn,  i3(t)v(t)>  ♦ 
Jtn 


s  < 


*  < 


f  T*(n,t)0(n)  |n  T(n,cr)^N(o)w(0)dodn,  C0(t)  -  At)v(t)>  ♦ 

1  to 

t*  n 

l  WCni  |  (T(n,a)  -  TN+wCn,a))^NCo)w(o)do,  1N+wCn,t)^NCt)V(t)>)dn  + 

t  t/v 
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+  <#(n)  |  (T(n,o)  -  T^fn.oj^cojw^da, 

ro 

TN+wCn,t)^N(t)v(t)>)dn  + 

t* 

*  J  <0(n)  -  3K,u(nt)  f 

*  % 

^  u(n,t)^N(t)vCt)>dn  < 

<  b2d/?iM2PQ(N)|w|  2  -i-  [e  (t  t°')-l]a+q)  + 


L 


+  lt  d(lt  e<1)  (  n"  bq  I w  ( °)  |d<^P  (N+U  >QN)bq^n  dn  + 


t*  ^ 

+  {  d({  P(Nni,QN)bq|w(a)|daVfeW(n'^bq^dn  ♦ 

1  t0  / 

+  d!  lQo_pN  ^Qol  I  {  {  M2eW(-n  0-)b2q2|w(o)|daea,^n't^  dn  < 

t  tQ 

<  b2dv^M2  P0(N)|w|  2  -i_  [e  Ct  t())-l](l+q)  + 


-q,-l2  — 


*  ®2<l2H>«  S(N*u,QN)|ft  f”  e"fn-0)|w(o)|dodn  *  f*  f  .«f"-‘)|.(0)|d„dn 

£  l0  J‘  \ 

*  <a>2g2R2«||Q0-PN*uQ0||  f  f  eS(n-°)e3('’-tV(o)|dodn  < 


5  b^H2.  (N)|w|  2  -1-  1.2“(t*'t»).1,(ltq)  . 


*  **- 


.fr  V 


>  4>  *  <  .  *'  #  ;  ♦« 


ja 
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db2q^M»^nP(N+M  ,(/*)  jw| 


1  “Ct*-t0)  tt*-tQ)1/2  »(t*-t0) 

<£**  *  “ 


te  “  -1) 


♦  dbW^IlQo-P^Qoll  |w 


~zz  Ce  0  -1) 
/w* 


The  bounds  on  Iy  and  IIv  imply 


SUP.  JccyCVmoi  5 


t€[tn,t"] 


<  Pq(N)b2^  M2(l+q) |w|^2 


P(N^A2^M  q2|w|  , 

L 


jL  +  _d. 


:u> 


,nv.  * 


2“(t  -tn) 
e  u  + 


tl-jz  *  (t‘-t0)1/Z)  * 
/2u 


+  d(— ±-  + 

JS? 


t  (t*-t„)1/2 


O) 


flQ0’pN+,JQollb2^2^  N 


/S5 


£ 


This  completes  the  proof. 


Proof  of  Theorem  2.2. 


(*)  |sN-HCt,S)*N4V  l|y*uct.n)«N(n)C(vf,‘)'1^>“zN^)(n)dr,| 

't°V4’,|  .  fc“h  Xq  |t|((V^'l‘)‘V'IJzNn')W)|dn < 
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<  fc“tt*'t°VU|  *  Me"lt*‘to’bq  (t*-t„)V2  C-1  (t._,  ,1/2  t 


ct  -t0)"‘  Kjl^l  . 


.  «**-v 


|z| (l+bq(t*-t0)c1K1) . 


(b)  |S(t,s)*  -  SN*y(t,s)PN+U2|  <  |T(t,s)z  -  T^Ct.siz^l  + 

+  jV(t,n)i3(n)(Vg1Wsz)(n)  -  Tft.n^CnjCCvJ’^'^^z^CnJldn  < 
+  Jt|TCtfrO^(TO(CvJ,u)"1ii5»,izNH,)(n)  - 

-  T^(tfrWN(^(CvJ^)-^zN,*l)C»0)dn  5 


<  p (N+u , z)  +  l^^'^blCV^WgZ)^)  -  ((V^’M)'1/*uzN+M)(n)|dn  + 

+  b(0,T(t*n)Qo  *  TWHI(t.nx/,||2dn)1/2  (|j (CV^,w)'1w^,wzN+M)(n)|2dn)1/2  < 
1  p(n+m  ,z)  ♦  b  (G-u^  ^|te2sr(t-n)dn)1/2  + 

+  b  (}sllTCt,n)Qo  -  T(t,n)QN| |2^n  ^  ♦ 


+  (fj|T(tfn)QN  -  ^(t,n)QN|i2dn)1/2  c”1lz|  Kj  (t*-tQ)1/2  < 
<  pCN+u.z)  ♦  b|u-CiN,u I  (i-  (e  t°^-l))1/2  + 


L  2w 
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+  bc'^zlKjCt*-^)1/2  MPQ(N)(|te2W ^t_ *2  +  P(Nni  ,QN)  (t*-tQ)1/2 
■  P(N+M,z)  +  b|u-uN,P|  (e2  ^  t())-l))1/2  + 

+  be  1 1  z  |  Kj  (t**tQ)  1/2MPq(N)^^-  (e^  ^  ^-l)^  + 

+  bc’1|z|K1(t*-t())  PfN+P.Q^)  = 

=  P(N+m ,z)  +  P(N+m,QN)|z|K6  +  |u-uN,M |  k5  ♦  |z|PQ(N)k6, 

0 

where 


Proof  of  Theorem  2.3. 

(a)  By  (2.13)  we  have  for  t  e  [t0 ,t*] 

|nN,uCt)zN*u|  s  |T"*“(t*>t)*FN^sN’1,(t*,t)2N*u|  * 
*  ljt  TN*“cn,t)*®N,ll(n)SN,utn,t)zN*1‘dn|  < 

<Ffe  fK5|z|+Jfe  0  dKs|z|(t*-t0). 
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(b)  <n(t)z  -  nN’H(t)zN4|\y>  =  <T(t\t)Vs(t*,t)z  - 

-  TN+;,(t*,t)*FN+»JSN*W(t*,t)zN+W,y>  ♦ 

+  jZ*< T(n,t)*0(n)S(n,t)z  - 

-  T^n,t)VNn)SN’w(mt)zN\yvdn  « 

<  <JFS(t*,t)z,  T(t*,t)y  -  +  <J*S(t*,t)z  - 

-  <W^(^t)zN^  + 

+  <(-^-FN'M)SN’M(t*ft)ZN"V,TN'w(t*,t)y>  + 

*jt  (<^Cn)SN,u(n>t)z,  T(n,t)y  -  i^c n,t)y>  + 

+  <  0(n)S(n,t)z  -  ^(n)SN,M  (n,t)zN+w,TN+MCn,t)y>  )dn 
+  f|  <^Cn)sMn,t)zN+v  -  ^N+u(n)sN,vl(n,t)zN+y,TN+u(n,t)y>dn  < 

<  fKs|z|p(N+U,y)  +  (f+d(t*-t0))[Ffe  0  Jyj  (P(N+M,z)  + 

+  P(N+M  »Q^)  I  z|Kg  ♦  +  |z|pQ(N)k6]  ♦ 

+  II  Qq-^Qq  Ilfl^WW#  °V|  +  dK5|z|(t*-t0)p(N+M>y)  + 


i 


6S 


-t  ) 

+  1 1 Q0~PN+^1Qo I  ldCt*-tQ)Kj| z|Kks  0  |y|  = 

w(t*-t  ) 

=  [f+d(t*-tQ)  ]  [Ks|  z|  p(N+u ,  y)  +  K$M  e  0  |y|  |  z|||Q0-PN+\|  |  + 

U)(t*-tn)  M  w  . 

+  M  e  U  |y|[p(N+P,z)  +  P(N+p,QN)|z|K6  +  |u-u  ,y|  2k$  +  |  z|  p^CN)^]  ] . 

L 

Proof  of  Corollary  2.2. 

|J(t0,PN+yz,uN,w)  -  J(t0,z,u)j  = 

=  |<FN+MzN,M(t*),zN’VJ(t*)>  -  <5*z(t*),z(t*)>|  + 

+  [  |<^N+M(t)zN’M(t),zN’M(t)>  -  <^(t)z(t),z(t)>|dt  + 

t0 

t* 

+  [  |(C(t)GN’MCt),aN’W(t))  -  (C(t)u(t)  ,u(t)))  jdt  < 

Jto 

<  .  ^zN,M(t*),zN>,JCt*)>  + 

+  (FP1(zN'P(t*)  -  z(t*)),  PlZN'y(t*))  +  (FPjZ(t*) ,  P1(zN'M(t*)  -  z(t*)))  + 
+  f1  |<^N+y(t)zN,u(t)  -  5?(t)zN,y(t),zN’U(t)>  + 

Jto 

♦  <^(t)(zN’y(t)  -  z(t)),zN’y(t)>  +  <^(t)z(t),zN’M(t)  -  z (t)> | dt  ♦ 

+  f  l(C(t)(u(t)  -  uN,y(t)),u(t))  +  (C(t)uN,M (t),ult)  -  uN,y(t))|dt  < 

Jto 


» 
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=  ((t*-t0)d+f)K5|z|{2[p(N+M,z)  +  P(N+u,QN)|zjK6  +  |G-aN’u|  2k5  + 

Li 

+  |z|pQ(N)k6]  +  I  IP^Qo'QqI  lK5lz|}  + 

+  2|a-aN‘y|  2c'1K1(t*-t0)1/2sup||C(t)||  |z|, 

L 


which  completes  the  proof. 

Proof  of  Theorem  2.4.  By  Remarks  2.4  and  (2.10)  it  follows  that  u  is  continuous. 

* 

Moreover  by  (2.15)  we  have 

I u(t)  -  GN’°(t)|  =  lc(t)*1^(t)*(n(t)S(t,t0)z  -  nN,0(t)sN,0(t,t0)PNz)| . 

Let  eN(t)  =  sgn  C(t)  _1^(t)*(n(t)  S(t,t0)z  -  nN’0(t)SN’0(t,t())PNz) ,  then 

|u(t)  -  uN,0(t)|  <  <n(t)S(t,t0)z  -  HN'°SN»°(t,t0)PNz,  ^(t)(C(t)'1)*eN(t)>. 

By  Corollary  2.1(c)  and  after  our  inspection  of  (2.16)  and  the  proof  of 
Theorem  2.3(b)  it  now  follows  that 

I£(t)  -  uN’°(t)l  <  sup  KgtPCN^jlzl  +  P(N,z)kl  +  UI|z|(Pq(N)  +  POi.Q,,))] 

5' 

where  the  supremum  is  taken  over  (^(t)(C(t)  1)*£N(t)| 
t  €  [tQft*],  N  *  1,2,...}  a  relatively  compact  subset  of  Z. 

(HI),  (H2),  together  with  (vii)  and  (viii)  in  Section  2,  and  a 
simple  compactness  argument  imply  the  result. 
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